A methodological study to compare survey-based and observation-based evaluations of organisational and safety cultures and then compare both approaches with markers of the quality of care.
نویسندگان
چکیده
BACKGROUND Patient safety concerns have focused attention on organisational and safety cultures, in turn directing attention to the measurement of organisational and safety climates. OBJECTIVES First, to compare levels of agreement between survey- and observation-based measures of organisational and safety climates/cultures and to compare both measures with criterion-based audits of the quality of care, using evidence-based markers drawn from national care standards relating to six common clinical conditions. (This required development of an observation-based instrument.) Second, to examine whether observation-based evaluations could replace or augment survey measurements to mitigate concerns about declining response rates and increasing social desirability bias. Third, to examine mediating factors in safety and organisational climate scores. DESIGN The study had three strands: (A) a postal questionnaire survey to elicit staff perceptions of organisational and safety climates, using six prevalidated scales; (B) semistructured non-participant observation of clinical teams; and (C) a retrospective criterion-based audit carried out by non-clinical auditors to minimise hindsight bias. Standardised summary scores were created for each strand, and pairs of measurements were compared (strand A with strand B, strand A with strand C, and strand B with strand C) using Bland-Altman plots to evaluate agreement. Correlations were also examined. Multilevel modelling of Strand A scores explored mediating factors. SETTING AND PARTICIPANTS Eight emergency departments and eight maternity units in England, UK. INTERVENTIONS None. MAIN OUTCOME MEASURES Examination of feasibility, correlation and agreement. RESULTS Strand A: the overall response rate was 27.6%, whereas site-specific rates ranged from 9% to 47%. We identified more mediating factors than previous studies; variable response rates had little effect on the results. Organisational and safety climate scores were strongly correlated (r = 0.845) and exhibited good agreement [standard deviation (SD) differences 0.449; 14 (88%) within ± 0.5; one large difference]. Two commonly used scales had high levels of positive responses, suggesting positive climates or social desirability bias. Strand B: scoring on a four-point scale was feasible. Observational evaluation of teamwork culture was good but too limited for evaluating organisational culture. Strand C: a total of 359-399 cases were audited per condition. The results varied widely between different markers for the same condition, so selection matters. Each site performed well on some markers but not others, with few consistent patterns. Some national guidelines were contested. Comparisons: the comparison of safety climate (survey) and teamwork culture (observation) revealed a moderately low correlation (r = 0.316) and good agreement [SD differences 1.082; 7 (44%) within ±0.5; one large difference]. The comparison of safety climate (survey) and performance (audit) revealed lower correlation (r = 0.150, i.e. relationship not linear) but reasonably good agreement [SD differences 0.992; 9 (56%) within ± 0.5; two large differences]. Comparisons between performance (audit) and both organisational climate (survey) and teamwork culture (observation) showed negligible correlations (< 0.1) but moderately good agreement [SD differences 1.058 and 1.241; 6 (38%) and 7 (44%) within ± 0.5; each with two large differences (at different sites)]. Field notes illuminated large differences. CONCLUSIONS Climate scores from staff surveys are not unduly affected by survey response rates, but increasing use risks social desirability bias. Safety climate provides a partial indicator of performance, but qualitative data are needed to understand discrepant results. Safety climate (surveys) and, to a lesser degree, teamwork culture (observations) are better indicators of performance than organisational climate (surveys) or attempts to evaluate organisational culture from time-limited observations. Scoring unobtrusive, time-limited observations to evaluate teamwork culture is feasible, but the instrument developed for this study needs further testing. A refined observation-based measure would be useful to augment or replace surveys. FUNDING The National Institute for Health Research Health Technology Assessment programme.
منابع مشابه
Comparing the Persian version properties of Behavioral Pain Scale and Critical Care Pain Observation Tool in patients with head trauma
Introduction: The assessment of pain in critically ill patients requires careful examination, especially in intubated and traumatic head patients due to the impossibility of using verbal pain scales and changes in non-verbal communication due to the type of injury sustained .The purpose of this study was to compare the psychometric properties of the Persian version of Behavioral Pain Scale (BPS...
متن کاملبررسی استانداردهای ایمنی و کیفیت مراقبت بیمارستان های آموزشی منتخب بررسی استانداردهای ایمنی و کیفیت مراقبت بیمارستان های آموزشی منتخب بینالملل(JCI) در سال 90-91
Abstract Background: Accreditation is a program that is designed for evaluation of health care organizations and measured processes and structures according to predetermined standards. The purpose of this study is to survey the safety situation and quality of care in selected hospitals of Tehran University of medical sciences based on the Joint Commission International (JCI) standards and de...
متن کاملComparing the educational effect based on critical thinking and routine approaches on skills to manage of pre-eclampsia and persistence of knowledge of midwifery students
BACKGROUND AND OBJECTIVE: Preeclampsia is a special syndrome of pregnancy and common cause of mothersﹸdeath associated with delay in diagnosis and nursing staff’s inappropriate control. The current study was carried out to compare the effect of training on method based on critical thinking and traditional education on maintenance of knowledge level and clinical skill of controlling preeclampsia...
متن کاملA Safety-II Perspective on Organisational Learning in Healthcare Organisations; Comment on “False Dawns and New Horizons in Patient Safety Research and Practice”
In their recent editorial Mannion and Braithwaite provide an insightful critique of traditional patient safety improvement efforts, and offer a powerful alternative vision based on Safety-II thinking that has the potential to radically transform the way we approach patient safety. In this commentary, I explore how the Safety-II perspective points to new directions for organisational learning in...
متن کاملA survey to study and compare factors affecting human resources efficiency
Introduction: The human resources are considered the main asset of anysociety. If used properly and effectively, it will create other sources and above all the added value. The quality of the life is usually dependent on the quality of human professional life including factors such as job security, services and welfare pensions, health services, income, and job quality. The purpose of this stud...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Health technology assessment
دوره 16 25 شماره
صفحات -
تاریخ انتشار 2012